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Multi-technology sensors are being developed 
for medical, manufacturing, personal health 
and other applications not previously possible 
with historic single-technology sensors 


Richard Bloss 
Sensor Review, Cleveland, Ohio, USA 


Abstract 

Purpose — The purpose of this paper is to review the advancements in new multi-technology sensor products being developed or already serving the 
market and to explore such applications. The paper also addresses some hacking problems which may arise. 

Design/methodology/approach — This paper is a review of published information and papers on multi-technology sensor research as well as 
contact and discussions with multi-technology sensor researchers and suppliers in this field. 

Findings — Microelectronics and electrochemical technologies have been major factors in the multi-sensor technology advancements of sensors for 
a wide range of applications. Sensors are becoming much smarter; solving application problems better than has been previously possible with 
single-technology sensors. Multi-technology sensors in many cases may offer better resolution and are much more sensitive than single technology 
sensors in the past. 

Practical implications — Readers may be very excited to learn of the many advances in multi-technology sensors which are coming to the sensor 
field. Applications that were previously served with more than one sensor or were not possible before are now being served by multi-technology 
sensors. One such application which many readers may not be aware of but may be using is the wearable individual exercise sensor. One such 
device is the Apple Watch which will be reviewed in some detail later in this paper. 

Originality/value — No previous review of multi-technology sensing has been observed. 
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noise ratio (SNR) model which helps overcome the noise 
impediments. The microphone is based on a dual back plate 
microelectromechanical systems (MEMS) technology. The 
SNR of the microphone also helps the performance. 

An audio processor by XMOS analyses the signal data from 
the digital microphone and adjusts the microphone beam angle 
toward the target sound source. This combination of sensors 
and supporting electronics provides a sensor system superior to 


two or more sensor technologies in the same device. Such 
multi-tech devices can address sensor needs in a much smarter 
manner than was ever possible before. In some cases, multi- 
tech sensors are addressing sensing applications not previously 
possible before. 


Voice recognition 


Two German companies, Infineon Technologies AG and existing voice controlled devices while providing a clear 
XMOS Ldt., have come together to develop and offer a new understanding of commands and flawless execution the 
two technology voice recognition sensor. The device combines prevents unwanted activation. Visit www.infineon.com/5G for 
radar and a silicon microphone. The goal is to capture a specific further information on this voice/radar sensor. 

voice from a collection of sounds and voices in the target area. 

The radar target presence detection provides the location of the Sensor for maritime sailing and racing 


desired sound source. Then the silicon microphone targets the 
AIRMAR® Technology Corporation has recently introduced a 


multi-technology sensor (DX900 + MultiLog Sensor) which 
captures a ship’s transverse and longitudinal speed using a dual 
axis electromagnetic log. The device also senses the water 
depth and the water temperature. Such better information 
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provides the ship captain with the ability to better control the 
craft. For racing craft, this can be a very important benefit. 

The water temperature sensor is fast response. A three-axis 
accelerometer monitors heel and trim. The device coupled with 
external computing power can output in real-time water 
temperature and depth, as well as the leeway angle and the speed 
of the ship through the water. The device is Bluetooth® enabled 
for connection to onboard computer tablet or smart phone 
displays to make such calculations and to track ship performance. 

The sensors offer the following range of information for 
calculation of performance, water depth and temperature: 

+ depth range = 60 m; 

* transverse speed range = +/— 6 knots; 

+ longitudinal speed range = +/— 60 knots; and 

* accuracy of speed = +/- 0,1 knots for speeds under 10 
knots, +/—1 per cent for speed above 10 knots. 


The sensor pens that are in contact with the water are made of 
high-quality alloy helping to insure very stable measurements 
and high resistance to corrosion. Visit www.airmar.com for 
further information on the DX900 +. 


Improved imaging devices 


Scientists at the University of Twente in The Netherlands 
along with collaboration with several independent companies 
have developed a prototype handheld medical imaging device 
that combines diode laser, optics and ultrasound technologies. 

Combining ultrasound and photo acoustics has made the 
device offer considerably more functional information to the 
medical professional as to the location of blood in the human 
body than was previously possible. The combination of 
technologies is made possible with integration of pulsing diode 
lasers with optics and ultrasound detectors. The key is heat 
from the light of the laser pulses when it reaches the blood 
vessel; it causes an increase in blood pressure which can be 
measured on the skin. 

The technology is well suited for measurements up to 15 mm 
under the skin. The technology helps physicians gain information 
about inflammation under the skin. Other applications may 
include ailments such as skin cancer, burns or hardening of the 
arteries. More information is available at www.utewente.nl/mira/ 
news 


Security camera 


Bosch Security Systems has developed a dual camera, the MIC 
IP fusion 9000i camera, containing two imaging technologies. 
First is the usual optical imaging and second is a thermal 
imaging sensor. The dual imaging technology offers unique 
features of video analytics and meta-data fusion which can 
provide users with full situation awareness and early object 
detection. Visit www.boschsecurity.com for more information. 


Drone mounted multi-camera sensor systems 


FLIR Systems Inc. has introduced a DUO™ multi-camera 
sensor using both a thermal micro camera and a high definition 
1080p visible camera in a package for use onboard unmanned 
drone aircraft (Figure 1). The Duo R™ model camera system 
can also provide temperature measurements in real time. The 
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Figure 1 FLIR DUO with visible and thermal imaging capability for 
drone applications 


Source: FLIR, used with permission 


camera sends onboard image recordings to a micro SD card ad 
provides real-time remote control of camera functions. Remote 
operators can switch between the Duo’s thermal and visual 
cameras in flight or view both in a picture in pictures mode. 

FLIR also produces the PT-Series HD, powerful pan and tilt 
security camera systems. They include a cooled or uncooled 
thermal camera and a 12x optical zoom and a 30 x HD visible 
camera. Visit www.flir.com for further information. 

Another product from FLIR is their AX8'™™ thermal 
imaging camera for continuous condition and _ safety 
monitoring (Figure 2). The unit combines both thermal 
imaging with visual cameras in a small and affordable 
package. 

The unit can provide a streaming video output which can be 
used for automatic alarming for pre-set temperature thresholds 
are exceeded as well as temperature trend analysis. The 
package is only 54 x 25 x 95 mm and can easily installed in 
constrained spaces and provide uninterrupted monitoring of 
critical electrical and mechanical equipment. 

Imaging can be separate from each sensor or the imaging can 
be combined for multi-spectral dynamic imaging. This can 
result in sharper edge detail, better ability to read labels and 
contextual awareness. 


Wearable multi-technology sensing devices 


The Apple, Inc. Apple Watch™™ may well be the most well- 
known family of wearable human activity sensing products but 
is not the only such multi-tech sensing device (Figure 3). 
Several such devices including the Apple Watch will be 
reviewed. A number of forecasters have spoken out on the 
growth potential for wearable sensing devices. The Swiss 
research firm, Sorecon, has forecast that the wearables market 
might top US$40bn by 2020 for health care only applications. 
A tech industry insider has estimated that Apple sold about six 
million Apple Watches just in the last quarter of 2016. 
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Figure 2 FLIR AX8 thermal and visual camera package 


Source: FLIR, used with permission 


Figure 3 The Apple Watch with blood pressure and activity sensing 


Source: Apple Inc. used with 
permission 


Patty Nichols, second Vice President of Medical 
Technology Underwriting at Travelers Insurance, has been 
quoted as saying the growth potential for medical wearables 
is extraordinary. There are however concerns that 
technology errors and reliability may be continuing 
technology issues for the industry. Watch firms such as Tag 


Heuer, Tommy Hilfiger and Hugo Boss are known to be 
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teaming up with Google to create their own smart watch 
products. 

The Apple Watch is worn on the wrist as a real watch and 
does include time display. It also has two human factor 
sensing technologies. First is a blood pressure detector 
which can provide real time information about the wearer’s 
blood pressure as well as pulse rate. A second sensor detects 
acceleration which allows the device to calculate movement 
of the wearer. 

The Apple Watch senses blood rate by shining an infrared 
light from laser diodes on a blood vessel thus increasing the 
blood pressure for detection by photo diodes. The watch 
includes 8 GB of data storage. The Apple Watch2 includes a 
global positioning system chip. 

Recent news from Apple indicates that the company has 
been researching sensing technology that will enable Apple 
to add blood sugar sensing to the Apple Watch family of 
products. The indication is that Apple is trying to apply 
optical sensing to detect blood sugar molecules in the blood 
stream as it passes under the Apple Watch. Blood sugar 
monitoring is important in the control of diabetes. Wearers 
of the Apple Watch with blood sugar monitoring will be 
better able to monitor and control blood sugar levels in real 
time. Such patients need to inject insulin to reduce excess 
high blood sugar levels as soon as detected. 

The Apple Watch must be paired with an iPhone 5 or later to 
achieve the full benefits of the data gathering and interpretation 
that can be accomplished. Many fitness trackers require a smart 
phone connected by Bluetooth and a fitness app to completely 
process and report the fitness data. Visit www.apple.com/watch 
for more info on the Apple Watch family. 

Another exercise health data-gathering-type wearable is the 
FITBIT™, a family of wearable arm bands. FITBIT™ has a 
number of models of wearable fitness trackers including 
Charge2 Activity, Flex Sport, Charge H12 Wireless, Charge 2 
Heart Rate, Flex Wireless, Alta and Unisex. 

FITBIT senses the wearer’s movement such as that of steps 
as well as blood pressure. It can then calculate calories used, 
distance traveled and heart rate. More info on the FITBIT is 
available at www.fitbit.com 

A South Korean company, Kairos Watches in Seoul, has 
developed some advanced wearable watch-based sensors. 
Their T-Band watch includes a nine-axis gyroscope, 
accelerometer, compass, optical sensors and a galvanic skin 
sensor which detects body temperature and sweat. Other 
developments underway include integrating a capacitive 
pressure sensor into the T-Band watch. This sensor would 
monitor pulse and blood pressure. Research on capacitive 
tactile pressure sensing is underway and further information 
on the technology can be seen at http://info.hotims.com/ 
65850-161 

The field of wearable fitness tracker field is crowded and 
includes besides Apple and Fitbit devices from Jawbone UP4, 
Garmin Virofitz, Bodymedia Fit, BIETIA Fitness tracker, 
Blueweight Bluetooth, Polar Electric CopperFit, DirectLife, 
Nike Fuelbandse, Basis B1 Band, Motorola Moto360 and 
LGGWatch R. 

For further information on other types of wearable devices 
visit the wearable medical sensor article by Bloss (2015). 
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Industrial wearable device 


Another human wearable is the “Mark” industrial smart glove by 
ProGlove (Figure 4). The initial ProGlove product is only a glove 
with an embedded bar code scanner designed to aid the wearer in 
efficiently performing picking, packing, assembly, quality checks 
and more in the industrial environment. The typical scan and 
pick with the current bar code only sensor is 4 s per pick. 

While not yet a multi-technology device, the firm is currently 
investigating incorporating other sensor technologies such as 
motion sensing and RFID sensing to extend the capabilities of 
the MARK ProGlove. The MARK ProGlove provide real-time 
acoustic feedback, as well as wireless connection, such as Blue 
Tooth, with a support computer. The battery life per charge for 
the current device is 8-10 h. ProGlove is a unit of the German 
company Workaround GmbH. Visit www.proglove.de for 
further information on the ProGlove device. 


Machine mounted multi-tech sensing devices 


Herrmann Ultrasonics has combined a RFID sensor and an 
optical sensor into a sensing device for their HiQ Vario 
ultrasonic welding machine (Figure 5). The dual technology 
sensor is also available on the Herrmann HiQ Dialog Speed 
Control ultrasonic welding machine. 

The color camera in the welder determines if the correct part 
is loaded and the correct welding program is being deployed. 
The RFID sensor helps determine if the correct welding fixture 
is being deployed. The RFID chio is mounted in the base of the 
work piece holding fixture. 

Herrmann Ultrasonics is a unit of Herrmann Ultraschalltechnik 
GmbH & Co. KG of Karlsbad German. These dual sensing 
machines can process 10 to 15 parts per minute on manual 
machines and as many as 60 to 70 parts per minute on the 
automatic welding systems. Visit www.herrmannUltrasonics.com 
for more information on the Herrmann dual sensing device and 
welding systems. 


Figure 4 The ProGlove Mark™ smart glove with an embedded RFID 
sensor for industrial handling applications 


Source: ProGlove, a unit of Workaround GmbH, used with 
permission 
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Figure 5 Herrmann RFID chip shown below the optical sensor on the 
automated welding system 


Source: Herrmann Ultrasonics, used with permission 


Inertial measurements 


TE Connectivity has developed a user configurable six degree 
of freedom inertial measurement system containing three 
internal accelerometers, three internal rate gyros and two 
temperature sensors (Figure 6). The 65210E device also 
includes battery voltage and current monitor, signal processor 
inter-range instrumentation group time code, optional 
frequency modulation transmitter and high-capacity Li Ion 


Figure 6 Inertial measurement system by TE connectivity 


Source: Measurement Specialties, Inc. a unit of TE 
Connectivity, used with permission 


Downloaded by UNIVERSITY OF ADELAIDE At 08:04 10 November 2017 (PT) 


Multi-technology sensors 


Sensor Review 


Richard Bloss 


Figure 7 Swift cold storage temperature and humidity sensor 


Source: Swift Sensors used with permission 


battery. For further information on the six degree of freedom 
device, e-mail pvg.cs.amer@mass-spec.com 


Temperature and humidity sensing 


Swift Sensors has developed a sensor designed to monitor 
temperature and humidity for places that cold store food and 
other products (Figure 7). The wireless battery powered units 
can communicate via wireless methods for safe storage of 
products sensitive to temperatures and humidity outside their 
specified range. 

The device can store sensor readings for up to 72 h should 
there be a power shortage in the storage facility. Visit www. 
swiftsensors.com for more information on the Swift Sensors. 


The future and possible problems? 


All is not fun and glory for the multi-tech sensor world. Multi- 
tech sensors of the type used in some fitness trackers which track 
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motion may be subject to security threats. The University of 
Michigan has been conducting a research project which 
demonstrates that such accelerometer motion sensors may be 
subject to hacking. Capacitive MEMS accelerometers are 
sensitive to precisely tuned acoustic tones. Such accelerometers 
are often used in wearable fitness devices. The right tones have 
been shown to deceive test models of accelerometers into 
registering false movement that never occurred. 

Researchers have also found that precisely tuned tones 
can trick sensors to output false signals which can result into 
delivering false reality into downstream microprocessors. 
Using just a speaker that cost only US$5, they injected 
factious steps into a FITBIT'™ wearable. In another 
experiment, the researchers caused a Samsung Galaxy S5'™ 
accelerometer to spell out the word “WALNUT”. The 
concern is that if autonomous sensor-based systems can be 
hacked then data from such systems may not be able to be 
trusted. Visit http://ns.umich.edu for further information 
about this University of Michigan accelerometer sensor 
security research project. 

Given the relatively new appearance of multi-technology 
sensing, the future looks very favorable for such technology. 
Sensor manufacturers and appliers will be pressing forward. 
The advent of the fast-growing microelectronic computing 
power and smart handheld devices such as the smart phone 
will add to the factors driving the rapid growth of this 
technology. 
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